Large Scoping Reviews: Managing volume and potential chaos in a pool of evidence sources.

Scoping reviews can identify a large number of evidence sources. This commentary describes and provides guidance on planning, conducting, and reporting large scoping reviews. This guidance is informed by experts in scoping review methodology, including JBI Scoping Review Methodology group members, who have also conducted and reported large scoping reviews. We propose a working definition for large scoping reviews that includes approximately 100 sources of evidence but must also consider the volume of data to be extracted, the complexity of the analyses and purpose. We pose six core questions for scoping review authors to consider when planning, developing, conducting, and reporting large scoping reviews. By considering and addressing these questions, scoping review authors might better streamline and manage the conduct and reporting of large scoping reviews from the planning to publishing stage.

Interventions on gender equity in the workplace: a scoping review.

BACKGROUND: Various studies have demonstrated gender disparities in workplace settings and the need for further intervention. This study identifies and examines evidence from randomized controlled trials (RCTs) on interventions examining gender equity in workplace or volunteer settings. An additional aim was to determine whether interventions considered intersection of gender and other variables, including PROGRESS-Plus equity variables (e.g., race/ethnicity). METHODS: Scoping review conducted using the JBI guide. Literature was searched in MEDLINE, Embase, PsycINFO, CINAHL, Web of Science, ERIC, Index to Legal Periodicals and Books, PAIS Index, Policy Index File, and the Canadian Business & Current Affairs Database from inception to May 9, 2022, with an updated search on October 17, 2022. Results were reported using Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension to scoping reviews (PRISMA-ScR), Sex and Gender Equity in Research (SAGER) guidance, Strengthening the Integration of Intersectionality Theory in Health Inequality Analysis (SIITHIA) checklist, and Guidance for Reporting Involvement of Patients and the Public (GRIPP) version 2 checklist. All employment or volunteer sectors settings were included. Included interventions were designed to promote workplace gender equity that targeted: (a) individuals, (b) organizations, or (c) systems. Any comparator was eligible. Outcomes measures included any gender equity related outcome, whether it was measuring intervention effectiveness (as defined by included studies) or implementation. Data analyses were descriptive in nature. As recommended in the JBI guide to scoping reviews, only high-level content analysis was conducted to categorize the interventions, which were reported using a previously published framework. RESULTS: We screened 8855 citations, 803 grey literature sources, and 663 full-text articles, resulting in 24 unique RCTs and one companion report that met inclusion criteria. Most studies (91.7%) failed to report how they established sex or gender. Twenty-three of 24 (95.8%) studies reported at least one PROGRESS-Plus variable: typically sex or gender or occupation. Two RCTs (8.3%) identified a non-binary gender identity. None of the RCTs reported on relationships between gender and other characteristics (e.g., disability, age, etc.). We identified 24 gender equity promoting interventions in the workplace that were evaluated and categorized into one or more of the following themes: (i) quantifying gender impacts; (ii) behavioural or systemic changes; (iii) career flexibility; (iv) increased visibility, recognition, and representation; (v) creating opportunities for development, mentorship, and sponsorship; and (vi) financial support. Of these interventions, 20/24 (83.3%) had positive conclusion statements for their primary outcomes (e.g., improved academic productivity, increased self-esteem) across heterogeneous outcomes. CONCLUSIONS: There is a paucity of literature on interventions to promote workplace gender equity. While some interventions elicited positive conclusions across a variety of outcomes, standardized outcome measures considering specific contexts and cultures are required. Few PROGRESS-Plus items were reported. Non-binary gender identities and issues related to intersectionality were not adequately considered. Future research should provide consistent and contemporary definitions of gender and sex. TRIAL REGISTRATION: Open Science Framework https://osf.io/x8yae .

Trivalent and quadrivalent seasonal influenza vaccine in adults aged 60 and older: a systematic review and network meta-analysis.

OBJECTIVES: To compare the efficacy of influenza vaccines of any valency for adults 60 years and older. DESIGN AND SETTING: Systematic review with network meta-analysis (NMA) of randomised controlled trials (RCTs). MEDLINE, EMBASE, JBI Evidence-Based Practice (EBP) Database, PsycINFO, and Cochrane Evidence -Based Medicine database were searched from inception to 20 June 20, 2022. Two reviewers screened, abstracted, and appraised articles (Cochrane Risk of Bias (ROB) 2.0 tool) independently. We assessed certainty of findings using Confidence in Network Meta-Analysis and Grading of Recommendations, Assessment, Development and Evaluations approaches. We performed random-effects meta-analysis and network meta-analysis (NMA), and estimated odds ratios (ORs) for dichotomous outcomes and incidence rate ratios (IRRs) for count outcomes along with their corresponding 95% confidence intervals (CIs) and prediction intervals. PARTICIPANTS: Older adults (≥60 years old) receiving an influenza vaccine licensed in Canada or the USA (vs placebo, no vaccine, or any other licensed vaccine), at any dose. MAIN OUTCOME MEASURES: Laboratory-confirmed influenza (LCI) and influenza-like illness (ILI). Secondary outcomes were the number of vascular adverse events, hospitalisation for acute respiratory infection (ARI) and ILI, inpatient hospitalisation, emergency room (ER) visit for ILI, outpatient visit, and mortality, among others. RESULTS: We included 41 RCTs and 15 companion reports comprising 8 vaccine types and 206 032 participants. Vaccines may prevent LCI compared with placebo, with high-dose trivalent inactivated influenza vaccine (IIV3-HD) (NMA: 9 RCTs, 52 202 participants, OR 0.23, 95% confidence interval (CI) (0.11 to 0.51), low certainty of evidence) and recombinant influenza vaccine (RIV) (OR 0.25, 95%CI (0.08 to 0.73), low certainty of evidence) among the most efficacious vaccines. Standard dose trivalent IIV3 (IIV3-SD) may prevent ILI compared with placebo, but the result was imprecise (meta-analysis: 2 RCTs, 854 participants, OR 0.39, 95%CI (0.15 to 1.02), low certainty of evidence). Any HD was associated with prevention of ILI compared with placebo (NMA: 9 RCTs, 65 658 participants, OR 0.38, 95%CI (0.15 to 0.93)). Adjuvanted quadrivalent IIV (IIV4-Adj) may be associated with the least vascular adverse events, but the results were very uncertain (NMA: eight 8 RCTs, 57 677 participants, IRR 0.18, 95%CI (0.07 to 0.43), very low certainty of evidence). RIV on all-cause mortality may be comparable to placebo (NMA: 20 RCTs, 140 577 participants, OR 1.01, 95%CI (0.23 to 4.49), low certainty of evidence). CONCLUSIONS: This systematic review demonstrated efficacy associated with IIV3-HD and RIV vaccines in protecting older persons against LCI. RIV vaccine may reduce all-cause mortality when compared with other vaccines, but the evidence is uncertain. Differences in efficacy between influenza vaccines remain uncertain with very low to moderate certainty of evidence. PROSPERO REGISTRATION NUMBER: CRD42020177357.

An international modified Delphi process supported updating the web-based "Right Review" tool.

OBJECTIVE: The proliferation of evidence synthesis methods makes it challenging for reviewers to select the ''right'' method. This study aimed to update the Right Review tool (a web-based decision support tool that guides users through a series of questions for recommending evidence synthesis methods) and establish a common set of questions for the synthesis of both quantitative and qualitative studies (https://rightreview.knowledgetranslation.net/). STUDY DESIGN AND SETTING: A two-round modified international e-Delphi was conducted (2022) with researchers, health care providers, patients and policy makers. Panel members rated the importance/clarity of the Right Review tool's guiding questions, evidence synthesis type definitions and tool output. High agreement was defined as at least 70% agreement. Any items not reaching high agreement after Round 2 were discussed by the international Project Steering Group (PSG). RESULTS: Twenty-four experts from nine countries completed Round 1, with 12 completing Round 2. Of 46 items presented in Round 1, 21 reached high agreement. Twenty-seven items were presented in Round 2, with eight reaching high agreement. The PSG discussed items not reaching high agreement, including eight guiding questions, nine review definitions (predominantly related to qualitative synthesis) and two output items. Three items were removed entirely and the remaining 16 revised and edited and/or combined with existing items. The final tool comprises 42 items; nine guiding questions, 25 evidence synthesis definitions and approaches, and 8 tool outputs. CONCLUSIONS: The freely-accessible Right Review tool supports choosing an appropriate review method. The design and clarity of this tool was enhanced by harnessing the Delphi technique to shape ongoing development. The updated tool is expected to be available in Quarter 1, 2025.

Characterizing high-cost healthcare users among adults with back pain in Ontario, Canada: a population-based cohort study.

ABSTRACT: Some patients with back pain contribute disproportionately to high healthcare costs; however, characteristics of high-cost users with back pain are not well defined. We described high-cost healthcare users based on total costs among a population-based cohort of adults with back pain within the Ontario government's single-payer health system across sociodemographic, health, and behavioural characteristics. We conducted a population-based cohort study of Ontario adult (aged 18 years or older) respondents of the Canadian Community Health Survey (CCHS) with back pain (2003-2012), linked to administrative data (n = 36,605; weighted n = 2,076,937, representative of Ontario). Respondents were ranked based on gradients of total healthcare costs (top 1%, top 2%-5%, top 6%-50%, and bottom 50%) for 1 year following the CCHS survey, with high-cost users as top 5%. We used multinomial logistic regression to investigate characteristics associated with the 4 cost groups. Top 5% of cost users accounted for 49% ($4 billion CAD) of total healthcare spending, with inpatient hospital care as the largest contributing service type (approximately 40% of costs). Top 5% high-cost users were more likely aged 65 years or older (ORtop1% = 16.6; ORtop2-5% = 44.2), with lower income (ORtop1% = 3.6; ORtop 2-5% = 1.8), chronic disease(s) (ORtop1% = 3.8; ORtop2-5% = 1.6), Aggregated Diagnosis Groups measuring comorbidities (ORtop1% = 25.4; ORtop2-5% = 13.9), and fair/poor self-rated general health (ORtop1% = 6.7; ORtop2-5% = 4.6) compared with bottom 50% users. High-cost users tended to be current/former smokers, obese, and report fair/poor mental health. High-cost users (based on total costs) among adults with back pain account for nearly half of all healthcare spending over a 1-year period and are associated with older age, lower income, comorbidities, and fair/poor general health. Findings identify characteristics associated with a high-risk group for back pain to inform healthcare and public health strategies that target upstream determinants.

Youth, caregiver and healthcare professional perspectives on planning the implementation of a trauma-informed care programme: A qualitative study.

AIMS: To explore youth, caregiver and staff perspectives on their vision of trauma-informed care, and to identify and understand potential considerations for the implementation of a trauma-informed care programme in an inpatient mental health unit within a paediatric hospital. DESIGN AND METHODS: We applied the Interpretive Description approach, guided by complexity theory and the Implementation Roadmap, and used Applied Thematic Analysis methods. FINDINGS: Twenty-five individuals participated in individual or group interviews between March and June 2022, including 21 healthcare professionals, 3 youth and 1 caregiver. We identified two overarching themes. The first theme, 'Understanding and addressing the underlying reasons for distress', related to participants' understanding and vision of TIC in the current setting comprising: (a) 'Participants' understanding of TIC'; (b) 'Trauma screening and trauma processing within TIC'; (c) 'Taking "a more individualized approach"'; (d) 'Unit programming'; and (e) "Connecting to the community". The second theme, 'Factors that support or limit successful TIC implementation' comprises: (a) 'The need for a broad "cultural shift"'; (b) 'The physical environment on the unit'; and (c) 'Factors that may limit successful implementation'. CONCLUSION: We identified five key domains to consider within trauma-informed care implementation: (a) the centrality of engagement with youth, caregivers and staff in trauma-informed care delivery and implementation, (b) trauma-informed care core programme components, (c) factors that may support or limit success in implementing trauma-informed care within the mental health unit and (d) hospital-wide and (e) the importance of intersectoral collaboration (partnering with external organizations and sectors). IMPACT: When implementing TIC, there is an ongoing need to increase clarity regarding TIC interventions and implementation initiatives. Youth, caregiver and healthcare professional participants shared considerations important for planning the delivery and implementation of trauma-informed care in their setting. We identified five key domains to consider within trauma-informed care implementation: (a) the centrality of relational engagement, (b) trauma-informed care programme components, (c) factors that may support or limit successful implementation of trauma-informed care within the mental health unit and (d) hospital-wide and (e) the importance of intersectoral collaboration. Organizations wishing to implement trauma-informed care should consider ongoing engagement with all relevant knowledge user groups throughout the process. REPORTING METHOD: Standards for Reporting Qualitative Research (SRQR). PATIENT OR PUBLIC CONTRIBUTION: The local hospital research institute's Patient and Family Advisory Committee reviewed the draft study methods and provided feedback.

Recent innovations in long-term care coverage and financing: a rapid scoping review.

OBJECTIVES: To identify, chart and analyse the literature on recent initiatives to improve long-term care (LTC) coverage, financial protection and financial sustainability for persons aged 60 and older. DESIGN: Rapid scoping review. DATA SOURCES: Four databases and four sources of grey literature were searched for reports published between 2017 and 2022. After using a supervised machine learning tool to rank titles and abstracts, two reviewers independently screened sources against inclusion criteria. ELIGIBILITY CRITERIA: Studies published from 2017-2022 in any language that captured recent LTC initiatives for people aged 60 and older, involved evaluation and directly addressed financing were included. DATA EXTRACTION AND ANALYSIS: Data were extracted using a form designed to answer the review questions and analysed using descriptive qualitative content analysis, with data categorised according to a prespecified framework to capture the outcomes of interest. RESULTS: Of 24 reports, 22 were published in peer-reviewed journals, and two were grey literature sources. Study designs included quasi-experimental study, policy analysis or comparison, qualitative description, comparative case study, cross-sectional study, systematic literature review, economic evaluation and survey. Studies addressed coverage based on the level of disability, income, rural/urban residence, employment and citizenship. Studies also addressed financial protection, including out-of-pocket (OOP) expenditures, copayments and risk of poverty related to costs of care. The reports addressed challenges to financial sustainability such as lack of service coordination and system integration, insufficient economic development and inadequate funding models. CONCLUSIONS: Initiatives where LTC insurance is mandatory and accompanied by commensurate funding are situated to facilitate ageing in place. Efforts to expand population coverage are common across the initiatives, with the potential for wider economic benefits. Initiatives that enable older people to access the services needed while avoiding OOP-induced poverty contribute to improved health and well-being. Preserving health in older people longer may alleviate downstream costs and contribute to financial sustainability.

Advancing the methodology of mapping reviews: A scoping review.

This scoping review aims to identify and systematically review published mapping reviews to assess their commonality and heterogeneity and determine whether additional efforts should be made to standardise methodology and reporting. The following databases were searched; Ovid MEDLINE, Embase, CINAHL, PsycINFO, Campbell collaboration database, Social Science Abstracts, Library and Information Science Abstracts (LISA). Following a pilot-test on a random sample of 20 citations included within title and abstracts, two team members independently completed all screening. Ten articles were piloted at full-text screening, and then each citation was reviewed independently by two team members. Discrepancies at both stages were resolved through discussion. Following a pilot-test on a random sample of five relevant full-text articles, one team member abstracted all the relevant data. Uncertainties in the data abstraction were resolved by another team member. A total of 335 articles were eligible for this scoping review and subsequently included. There was an increasing growth in the number of published mapping reviews over the years from 5 in 2010 to 73 in 2021. Moreover, there was a significant variability in reporting the included mapping reviews including their research question, priori protocol, methodology, data synthesis and reporting. This work has further highlighted the gaps in evidence synthesis methodologies. Further guidance developed by evidence synthesis organisations, such as JBI and Campbell, has the potential to clarify challenges experienced by researchers, given the magnitude of mapping reviews published every year.

Methodological review of NMA bias concepts provides groundwork for the development of a list of concepts for potential inclusion in a new risk of bias tool for network meta-analysis (RoB NMA Tool).

INTRODUCTION: Network meta-analyses (NMAs) have gained popularity and grown in number due to their ability to provide estimates of the comparative effectiveness of multiple treatments for the same condition. The aim of this study is to conduct a methodological review to compile a preliminary list of concepts related to bias in NMAs. METHODS AND ANALYSIS: We included papers that present items related to bias, reporting or methodological quality, papers assessing the quality of NMAs, or method papers. We searched MEDLINE, the Cochrane Library and unpublished literature (up to July 2020). We extracted items related to bias in NMAs. An item was excluded if it related to general systematic review quality or bias and was included in currently available tools such as ROBIS or AMSTAR 2. We reworded items, typically structured as questions, into concepts (i.e. general notions). RESULTS: One hundred eighty-one articles were assessed in full text and 58 were included. Of these articles, 12 were tools, checklists or journal standards; 13 were guidance documents for NMAs; 27 were studies related to bias or NMA methods; and 6 were papers assessing the quality of NMAs. These studies yielded 99 items of which the majority related to general systematic review quality and biases and were therefore excluded. The 22 items we included were reworded into concepts specific to bias in NMAs. CONCLUSIONS: A list of 22 concepts was included. This list is not intended to be used to assess biases in NMAs, but to inform the development of items to be included in our tool.

HIGHLIGHTS: • Our research aimed to develop a preliminary list of concepts related to bias with the goal of developing the first tool for assessing the risk of bias in the results and conclusions of a network meta-analysis (NMA).• We followed the methodology proposed by Whiting (2017) and Sanderson (2007) for creating systematically developed lists of quality items, as a first step in the development of a risk of bias tool for network meta-analysis (RoB NMA Tool).• We included items related to biases in NMAs and excluded items that are equally applicable to all systematic reviews as they are covered by other tools (e.g. ROBIS, AMSTAR 2).• Fifty-seven studies were included generating 99 items, which when screened, yielded 22 included items. These items were then reworded into concepts in preparation for a Delphi process for further vetting by external experts.• A limitation of our study is the challenge in retrieving methods studies as methods collections are not regularly updated.

Methods proposed for monitoring the implementation of evidence-based research: a cross-sectional study.

OBJECTIVES: Evidence-based research (EBR) is the systematic and transparent use of prior research to inform a new study so that it answers questions that matter in a valid, efficient, and accessible manner. This study surveyed experts about existing (e.g., citation analysis) and new methods for monitoring EBR and collected ideas about implementing these methods. STUDY DESIGN AND SETTING: We conducted a cross-sectional study via an online survey between November 2022 and March 2023. Participants were experts from the fields of evidence synthesis and research methodology in health research. Open-ended questions were coded by recurring themes; descriptive statistics were used for quantitative questions. RESULTS: Twenty-eight expert participants suggested that citation analysis should be supplemented with content evaluation (not just what is cited but also in which context), content expert involvement, and assessment of the quality of cited systematic reviews. They also suggested that citation analysis could be facilitated with automation tools. They emphasized that EBR monitoring should be conducted by ethics committees and funding bodies before the research starts. Challenges identified for EBR implementation monitoring were resource constraints and clarity on responsibility for EBR monitoring. CONCLUSION: Ideas proposed in this study for monitoring the implementation of EBR can be used to refine methods and define responsibility but should be further explored in terms of feasibility and acceptability. Different methods may be needed to determine if the use of EBR is improving over time.

Rapid Reviews Methods Series: Involving patient and public partners, healthcare providers and policymakers as knowledge users.

Rapid reviews (RRs) are a helpful evidence synthesis tool to support urgent and emergent decision-making in healthcare. RRs involve abbreviating systematic review methods and are conducted in a condensed timeline to meet the decision-making needs of organisations or groups that commission them. Knowledge users (KUs) are those individuals, typically patient and public partners, healthcare providers, and policy-makers, who are likely to use evidence from research, including RRs, to make informed decisions about health policies, programmes or practices. However, research suggests that KU involvement in RRs is often limited or overlooked, and few RRs include patients as KUs. Existing RR methods guidance advocates involving KUs but lacks detailed steps on how and when to do so. This paper discusses the importance of involving KUs in RRs, including patient and public involvement to ensure RRs are fit for purpose and relevant for decision-making. Opportunities to involve KUs in planning, conduct and knowledge translation of RRs are outlined. Further, this paper describes various modes of engaging KUs during the review lifecycle; key considerations researchers should be mindful of when involving distinct KU groups; and an exemplar case study demonstrating substantive involvement of patient partners and the public in developing RRs. Although involving KUs requires time, resources and expertise, researchers should strive to balance 'rapid' with meaningful KU involvement in RRs. This paper is the first in a series led by the Cochrane Rapid Reviews Methods Group to further guide general RR methods.

Minimal clinical datasets for spine-related musculoskeletal disorders in primary and outpatient care settings: a scoping review.

OBJECTIVES: Effective measurement and monitoring of health status in patients with spine-related musculoskeletal (MSK) disorders are essential for providing appropriate care and improving outcomes. Minimal clinical datasets are standardized sets of key data elements and patient-centered outcomes that can be measured and recorded during routine clinical care. Our scoping review aimed to identify and map current evidence on minimal clinical datasets for measuring and monitoring health status in patients with spine-related MSK disorders in primary and outpatient healthcare settings. STUDY DESIGN AND SETTING: We followed the JBI (formerly Joanna Briggs Institute) methodology for scoping reviews. MEDLINE, CINAHL, Cochrane Library, Index to Chiropractic Literature, MANTIS, ProQuest Dissertations and Theses Global, and medRxiv preprint repository were searched from database inception to August 1, 2021. Two reviewers independently screened titles and abstracts, full-text articles, and charted the evidence. Findings were synthesized and summarized descriptively. RESULTS: After screening 5,583 citations and 301 full-text articles, 104 studies about 32 individual minimal clinical datasets were included. Most minimal clinical datasets were developed for patient populations with spine-involving inflammatory arthritis, nonspecific or degenerative spinal pain, and MSK disorders in general. The minimal clinical datasets varied substantially in terms of the author-reported time-to-complete (1-48 minutes) and the number of items (5-100 items). Fifty percent of the datasets involved healthcare professionals in their development process, and only 28% involved patients. Health domain items were most frequently linked to the components of activities and participation (43.9%) and body functions (28.6%), according to the International Classification of Functioning, Disability, and Health. There is no standardized definition of minimal clinical datasets to measure and monitor health status of patients with spine-related MSK disorders in routine clinical practice. Common core elements identified were practicality, feasibility in a busy routine practice, time efficiency, and the capability to be used across different healthcare settings. CONCLUSION: Due to the absence of a standard definition for minimal clinical datasets for patients with spine-related MSK disorders, there is a lack of consistency in the selection of key data elements and patient-centered outcomes that should be included. More research on the implementation and feasibility of minimal clinical datasets in routine care settings is warranted and needed. It is essential to involve all relevant partners in the development process of minimal clinical datasets to ensure successful implementation and adoption in routine primary care.